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I. INTRODUCTION 

The interplay between network structure and dynamics has 
attracted a great deal of attention in connection with a variety 
of processes fij|, including epidemic spreading |2], conges- 
tion and cascadingfailures 0], and synchronization of cou- 
pled oscillators l4l5ll6ll^llM firlfTl[| . Much of this interest 
has been prompted by the discovery that numerous real-world 
networks [j]] share universal structural features, such as the 
small-world fl2ll and scale-free properties fl3ll . Small- world 
networks (SWNs) exhibit a small average distance between 
nodes and high clustering Hal . Scale-free networks (SFNs) 
are characterized by an algebraic, highly heterogeneous distri- 
bution of degrees (number of links per node) 1 1 3 ] . Most SFNs 
also exhibit a small average distance between nodes 11411 and 
this distance may become smaller as the heterogeneity (vari- 
ance) of the degree distribution is increased 1 15]. It has been 
shown that these structural properties strongly influence the 
dynamics on the network. 

In oscillator networks, the ability to synchronize is gener- 
ally enhanced in both SWNs and random SFNs as compared 
to regular lattices 11611 . However, it was recently shown that 
random networks with strong heterogeneity in the degree dis- 
tribution, such as random SFNs, are much more difficult to 
synchronize than random homogeneous networks |8], even 
though the former display smaller average distance between 
nodes |15]. This result is interesting for two main reasons. 
First, it challenges previous interpretations that the enhance- 
ment of synchronizability in SWNs and SFNs would be due to 
the reduction of the average distance between oscillators. Sec- 
ond, in networks where synchronization is desirable, it puts in 
check the hypothesis that the scale-free property has been fa- 
vored by evolution for being dynamically advantageous. 
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Previous work has focused mainly on the role played by 
shortest paths between nodes. By considering only shortest 
paths it is implicitly assumed that the information spreads 
only along them. However, the communication between os- 
cillators is more closely related to a process of diffusion on 
the network, which is a process involving all possible paths 
between nodes. Another basic assumption of previous work 
is that the oscillators are coupled symmetrically and with the 
same coupling strength 1 8]. Under the assumption of symmet- 
ric coupling, the maximum synchronizability may be indeed 
achieved when the coupling strength is uniform |9]. But to get 
a better synchronizability, the couplings are not necessarily 
symmetrical. Many real-world networks are actually directed 
fij] and weighed 1 17], and the communication capacity of a 
node is likely to saturate when the degree becomes large. 

In this paper, we study the effect that asymmetry and sat- 
uration of coupling strength have on the synchronizability of 
complex networks. We identify a physical process of informa- 
tion diffusion that is relevant for the communication between 
oscillators and we investigate the relation between this process 
and the stability of synchronized states in directed networks 
with weighted couplings. We address these fundamental is- 
sues using as a paradigm the problem of complete synchro- 
nization of identical oscillators. 

We find that the synchronizability is explicitly related to 
the mixing rate of the underlying diffusive process. For a 
given degree distribution, the synchronizability is maximum 
when the diffusion has a uniform stationary state, which in 
general requires the network of couplings to be weighted and 
directed. For large sufficiently random networks, the maxi- 
mum synchronizability is primarily determined by the mean 
degree of the network and does not depend on the degree dis- 
tribution and system size, in sharp contrast with the case of 
unweighted (symmetric) coupling, where the synchronizabil- 
ity is strongly suppressed as the heterogeneity or number of 
oscillators is increased. Furthermore, we show that the total 
cost involved in the network coupling is significantly reduced, 
as compared to the case of unweighted coupling, and is mini- 
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mum when the synchronizability is maximum. Some of these 
results were announced in Ref. 1 18]. 

The fact that the communication between oscillators takes 
place along all paths explains why the synchronizability 
does not necessarily correlate with the average distance be- 
tween oscillators. Moreover, the synchronizability of SFNs is 
strongly enhanced when the network of couplings is suitably 
weighted. This, in addition to the well know improved struc- 
tural robustness of SFNs 1 19], may have played a crucial role 
in the evolution of many SFNs. 

The paper is organized as follows. In Sec. [H] we intro- 
duce the synchronization model and the measure of synchro- 
nizability. In Sec.|ni] we study the corresponding process of 
diffusion. In Sec. IIVI we focus on the case of maximum syn- 
chronizability. The problem of cost is considered in Sec.|V] In 
Sec. IV II we present direct simulations on networks of maps. 
Discussion and conclusions are presented in the last section. 

II. FORMULATION OF THE PROBLEM 

We introduce a generic model of coupled oscillators and we 
present a condition for the linear stability of the synchronized 
states in terms of the eigenvalues of the coupling matrix. 

A. Synchronization Model 

We consider complete synchronization of linearly coupled 
identical oscillators: 

^ = f(x i )-a^2G ij h(x j ), i=l,2,...N, (1) 

where / = f(x) describes the dynamics of each individual 
oscillator, h = h(x) is the output function, G = {Gij) is the 
coupling matrix, and a is the overall coupling strength. The 
rows of matrix G are assumed to have zero sum to ensure that 
the synchronized state {xi(t) — s(t),\/i \ ds/dt = f(s)} is a 
solution of Eq. Q. 

In the case of symmetrically coupled oscillators with uni- 
form coupling strength, G is the usual (symmetric) Laplacian 
matrix L = (Lij): the diagonal entries are La — ki, where 
ki is the degree of node i, and the off-diagonal entries are 
Lij = — 1 if nodes i and j are connected and Lij = other- 
wise. For Gij = L^, heterogeneity in the degree distribution 
suppresses synchronization in important classes of networks 
||8|] (see also Ref. lUx ). The synchronizability can be easily 
enhanced if we modify the topology of the network of cou- 
plings. Here, however, we address the problem of enhance- 
ment of synchronizability for a given network topology. 

In order to enhance the synchronizability of heterogeneous 
networks, we propose to scale the coupling strength by a func- 
tion of the degree of the nodes. For specificity, we take 

G^ = L^ /k^ , (2) 

where (3 is a tunable parameter. We say that the network 
or coupling is weighted when (3 ^ and unweighted when 



(3 = 0. The underlying network associated with the Lapla- 
cian matrix L is undirected and unweighted, but for (3^0, 
the network of couplings becomes not only weighted but also 
directed because the resulting matrix G is in general asym- 
metric. This is a special kind of directed network where the 
number of /n-links is equal to the number of oMf-links in each 
node, and the directions are encoded in the strengths of in- 
and out-links. In spite of the possible asymmetry of matrix G, 
all the eigenvalues of matrix G are nonnegative reals and can 
be ordered as = Ai < A2 • • • < Xn, as shown below. 

B. Basic Spectral Properties 

Eq. (|3 can be written as 

G = D- p L, (3) 

where D = diag{fci, ki,. . . k^} is the diagonal matrix of de- 
grees. (We recall that the degree ki is the number of oscillators 
coupled to oscillator i.) From the identity det(D^ 13 L — XI) = 
&et(D~P/ 2 LD~P/ 2 — XI), valid for any A, where det denotes 
the determinant and / is the N x N identity matrix, we have 
that the spectrum of eigenvalues of matrix G is equal to the 
spectrum of a symmetric matrix defined as 

H = D-P^LD-P/ 2 . (4) 

That is, p(G) = p(H), where p denotes the set of eigenvalues. 
From this follows that all eigenvalues of matrix G are real, as 
anticipated above. It is worth mentioning that, although the 
eigenvalues of G and H are equal, from the numerical point 
of view it is much more efficient to compute the eigenvalues 
from the symmetric matrix H than from G. 

Additionally, all the eigenvalues of matrix G are nonneg- 
ative because H is positive semidefinite, and the smallest 
eigenvalue Ai is always zero because the rows of G have zero 
sum. Moreover, if the network is connected, then A2 > for 
any finite (3. This follows from the corresponding property for 
L and Eq. @, i.e., the fact that matrices H and L are congru- 
ent. Naturally, the study of complete synchronization of the 
whole network only makes sense if the network is connected. 

For j3 = l, matrix H is the normalized Laplacian matrix 
studied in spectral graph theory l2(ill . In this case, if N > 2 
and the network is connected, then < A2 < N/ (N — 1) and 
N / (N — 1) < A/y < 2. For spectral properties of unweighted 
SFNs, see Refs. jHHIH. 

C. Synchronizability 

The variational equations governing the linear stability of a 
synchronized state {xi(t) = s(t),\/i} of the system in Eqs. Q 
and (|2ji can be diagonalized into N blocks of the form 

^ = [Df(s) - aDh(s)} r,, (5) 

where D denotes the Jacobian matrix, a = aXi, and A^ are the 
eigenvalues of the coupling matrix G. The largest Lyapunov 
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exponent T(a) of this equation can be regarded as a master 
stability function, which determines the linear stability of the 
synchronized state for any linear coupling scheme 12411 : the 
synchronized state is stable if T(aXi) < for i = 2, . . . N. 
(The eigenvalue Ai corresponds to a mode parallel to the syn- 
chronization manifold.) 

For many widely studied oscillatory systems Q, l24ll . the 
master stability function T(a) is negative in a single, finite 
interval (0.1,0.2). Therefore, the network is synchronizable 
for some a when the eigenratio R = satisfies 

R < a 2 /ai. (6) 

The right-hand side of this equation depends only on the dy- 
namics (/, h, and s), while the eigenratio R depends only 
on the coupling matrix G. The problem of synchronization 
is then reduced to the analysis of eigenvalues of the coupling 
matrix [7]: the smaller the eigenratio R, the larger the syn- 
chronizability of the network, and vice versa. 

m. DIFFUSION AND BALANCE OF HETEROGENEITY 



b receives 1/2 unit from node a and 1/2 unit from node c, 
and each of the nodes a and c receives 1 unit from node b. 
Therefore, node b sends a total of 2 units and receives only 
1 unit, while each of the nodes a and c sends 1/2 unit and 
receives 1 unit. This means that there is an "absorption" of 
1/2 unit at each of the nodes a and c and the "emission" of 
1 unit at node b. It is in this sense that the matrix in Eq. l|8} 
describes a diffusive process with absorption and emission. 

On the other hand, the usual random walk process is conser- 
vative at each node. Such a process is described by the matrix 
D-^AC- 1 , where Qj = 8 l3 J2e~j k z~ P and the 

sum is over 

all the kj nodes connected to node j. For a node i connected 
to a node j and a uniform distribution, this conservation law 
implies that the amount of information that node i receives 
from node j depends on the degree of all the nodes connected 
to node j. But this is not what happens in a network of self- 
sustained oscillators. In a network of oscillators, the amount 
of information that oscillator i receives directly from oscilla- 
tor j can only depend on the strength of the coupling from j 
to i, which is proportional to l/fcf , as in the process described 
by the transition matrix in Eq. 0. 



We study a process of diffusion relevant for the communi- 
cation between oscillators and we argue that the synchroniz- 
ability is maximum (R is minimum) for /3 = 1. 

A. Diffusion Process 

From the identity 

N N 

Gyhfa) = E fc r% " Kx d )] (7) 

3 = 1 3=1 

we observe that the weighted coupling scheme in Eqs. Q and 
(|2j is naturally related to a diffusive process with absorption 
and emission described by the transition matrix 

P = J D ~ 0A > (8) 

where A = D — L is the adjacency matrix, and A is the 
largest eigenvalue of D~@A. According to this process, if we 
start with an arbitrary distribution y = (y*- 1 *, . . . y^ N '), where 
2/W is associated with the initial state at node i, after n time 
steps the distribution is P n y. This process is different from 
the usual (conservative) random walk process. In particular, 
because J2i Pij mav be different from 1, the diffusion in and 
out of a node may differ even in the stationary state. 

For instance, consider a network of three nodes, a-b-c, 
where nodes a and c have degree 1 and are both connected 
to node b. For f3 = 1, the transition matrix is 

/ 1 \ 
P = 1/2 1/2 . (9) 
V 1 J 

In the stationary state, each of the three nodes has, say, one 
unity (of the "diffusive quantity"). At each time step, node 



B. Balance of Heterogeneity 

Because the master stability function T(a) is negative in 
a finite interval (01,02), increasing (decreasing) the over- 
all coupling strength a beyond a critical value a max (a m i n ) 
destabilizes the synchronized state. Dynamically, the loss of 
stability is due to a short (long) wavelength bifurcation at 
er = <J ma x (cmm) Q (see also Ref. (Tl|)- Physically, this 
bifurcation excites the shortest (longest) spatial wavelength 
mode because some oscillators are too strongly (weakly) in- 
fluenced by the others. 

Now, consider the process of diffusion described by matrix 
P on a network where not all the nodes have the same degree. 
Starting with an arbitrary distribution y, after n steps we have 
P n y. If we require the (stationary) distribution for n — * 00 
to be uniform, we obtain j3 = 1 because this is the only case 
where yo = (1, 1, ... 1) is an eigenvector associated with the 
eigenvalue 1, which is the largest eigenvalue of matrix P. For 
f3 < 1, the distribution is more heavily concentrated on nodes 
with large degree. For /3 > 1, the concentration happens on 
nodes with small degree. Physically, this means that for both 
/3 < 1 and (3 > 1 some oscillators are more strongly influ- 
enced than others and the ability of the network to synchro- 
nize is limited by the least and most influenced oscillators: 
for small (large) a the system is expected to undergo a long 
(short) wavelength bifurcation due to the least (most) influ- 
enced nodes, as explained above. We then expect the network 
to achieve maximum synchronizability at f3 = 1. 

In Fig.^we show the numerical verification of this hypoth- 
esis for various models of complex networks. The networks 
are built as follows 1 26]: 

(2) Random SFNs ll27ll — Each node is assigned to have a 
number fcj > k m i n of "half-links" according to the 
probability distribution P(k) ~ fc~ 7 , where 7 is a seal- 
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ing exponent and k m in is a constant integer. The net- 
work is generated by randomly connecting these half- 
links to form links, prohibiting self- and repeated links. 
In the limit 7 = 00, all nodes have the same degree 

h — h 

(ii) Networks with expected scale-free sequence |22| — The 
network is generated from a sequence ki,k<z, ■ ■ -kpf, 
where fej > k min follows the distribution P(k) ~ kr 1 
and maxi kf < k%. A link is then independently 
assigned to each pair of nodes with probability 
Pij = kikj/J2i^i- I n this model, self-links are al- 
lowed. We observe, however, that the eigenratio R is 
insensitive to the removal of self-links. 



(Hi) Growing SFNs [28] — We start with a fully connected 
network with m nodes and at each time step a new node 
with to links is added to the network. Each new link is 
connected to a node i in the network with probability 
IT ~ (1 — p)ki + p, where foj is the updated degree of 
node i and < p < 1 is a tunable parameter. For large 
degrees, the scaling exponent of the resulting network 
is 7 = 3 + p[m(l — p)] _1 . For p — 0, the exponent is 
7 = 3 and we recover the Barabasi-Albert model 0. 



(iv) SWNs 1 29] — Starting with a ring of N nodes, where 
each node is connected to 2k first neighbors, we add 
M < N(N — 2k — l)/2 new links between randomly 
chosen pairs of nodes. Self- and repeated links are 
avoided. 

Our extensive numerical computation on the models (i-iv) 
shows that the eigenratio R has a well defined minimum at 
f3 = 1 in each case [Fig.[3. The only exception is the class of 
homogeneous networks, where all the nodes have the same de- 
gree k. When the network is homogeneous, the weights k~ 
can be factored out in Eq. l|8} and a uniform stationary distri- 
bution is achieved for any (3. In this case, the eigenratio R is 
independent of (3, as shown in Fig. [Ha) for random homoge- 
neous networks with k = 10 (solid line). A random homoge- 
neous network corresponds to a random SFN for 7 = 00. In 
all other cases, including the relatively homogeneous SWNs, 
the eigenratio exhibits a pronounced minimum at f3 = 1 (note 
the logarithmic scale in Fig.[Q. 

In SWNs, the heterogeneity of the degree distribution in- 
creases as the number M of random links is increased. The 
eigenratio R at (3 — reduces as M is increased, but the 
eigenratio at (3 = 1 reduces even more, so that the mini- 
mum of the eigenratio becomes more pronounced as the het- 
erogeneity of the degree distribution is increased [Fig.IHd)]. 
Similar results are observed in the original Watts-Strogatz 
model of SWNs, where the mean degree is kept fixed as the 
number of random links is increased IU2I1 . SWNs of pulse os- 
cillators also present enhanced synchronization at j3 = 1 q|. 

In SFNs, the heterogeneity increases as the scaling expo- 
nent 7 is reduced. As shown in Fig. ^a) for random SFNs, 
the minimum of the eigenratio R becomes more pronounced 
as the heterogeneity of the degree distribution is increased. 
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FIG. 1: Eigenratio R as a function of /3: (a) random SFNs with 
7 = 3 (•), 7 = 5 (■), and 7 = 00 (solid line), for k m in = 10; (b) 
networks with expected scale-free sequence for 7 = 3 and k m i n = 
10; (c) growing SFNs for 7 = 3 and m = 10; (d) SWNs with 
M — 256 (•) and M = 512 (■), for k = 1. Each curve is the result 
of an average over 50 realizations for TV = 1024. 



The same tendency is observed across different models of net- 
works. For example, for a given 7 and k m i n = k m i n , the 
minimum of the eigenratio is more pronounced in networks 
with expected scale-free sequence [Fig.[3b)] than in random 
SFNs [Fig. [Ha)], because the former may have nodes with de- 
gree smaller than k m i n - F° r small 7, the eigenratio in growing 
SFNs [Fig.^c)] behaves similarly to the eigenratio in random 
SFNs [Fig.^a)]. A pronounced minimum for the eigenratio 
R at (3 = 1 is also observed in various other models of com- 
plex networks 1 30 ] . 



C. Mean Field Approximation 

A mean field approximation provides further insight into 
the effects of degree heterogeneity and the dependence of R 
on (3. 

The dynamical equations Q can be rewritten as: 



dxi 
~dt 



f(xi) + ok\ P[hi - h(xi)], 



where 



hi = -r-^Aijhio 



(10) 



(11) 



is the local mean field from all the nearest neighbors of os- 
cillator i. If the network is sufficiently random and the sys- 
tem is close to the synchronized state s, we may assume that 
hi « h(s) and we may approximate Eq. dlOt i as 



dxj 
~~dt 



f{xi)+o-k]- [h{s)-h{xi)}, 



(12) 
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indicating that the oscillators are decoupled and forced by a 
common oscillator with output h(s). 

From a variational equation analogous to Eq. (|5j, we have 
that all oscillators in Eq. (II 21 will be synchronized by the 
common forcing when 



ol\ < ok) P < OLi Vi. 



(13) 



For (3 7^ 1, it is enough to have a single node with degree 
very different from the others for this condition not to be sat- 
isfied for any a. In this case, the complete synchronization be- 
comes impossible because the corresponding oscillator cannot 
be synchronized. Within this approximation, the eigenratio is 

R = {k max / fcmin) 1 ^ f°r ft — 1 an d R — (kmin I k max )^ 

for (3 > 1, where k mm = min^fe;} and k max = maxj{fcj}. 
The minimum of R is indeed achieved at (3 = 1, in agreement 
with our numerical simulations. 

Therefore, this simple mean field approximation not only 
explains the results of Ref. |8] on the suppression of synchro- 
nizability due to heterogeneity in unweighted networks, but 
also predicts the correct condition for maximum synchroniz- 
ability in weighted networks. 



IV. MIXING RATE AND SYNCHRONIZABILITY 

We relate the eingenratio R to the mixing rate of the pro- 
cess of diffusion introduced in Sec. IIII Al and we argue that, for 
(3=1 and large, sufficiently random networks, the synchro- 
nizability depends only on the mean degree of the network. 



A. Mean Degree Approximation 

We now present a general physical theory for the eigenratio 
R. In what follows we focus on the case of maximum syn- 
chronizability (J3 = 1). For (3=1 and an arbitrary network, 
Eq. (|8} can be written as 



P = D- 1/2 (I - H)D 



,1/2 



(14) 



where H = D~ 1 / 2 LD~ 1 I' 2 as in Eq. From the identity 
det(P - XI) = det(I — H — XI), valid for any A, it follows 
that the spectra of matrices P and H are related via p(P) = 
1 — p(H), and the uniform stationary state of the process P n y 
is associated with the null eigenvalue of the coupling matrix 
G. We then define the mixing rate as v = In /it -1 , where 



(i= lim \\P n y-y 



il/r. 



(15) 



is the mixing parameter, yo = (1, 1, ... 1) is the stationary 
distribution discussed in Sec. IIII B I y is an arbitrary initial 
distribution normalized as fcjj/j = J^i k%, and || ■ || is the 
usual Euclidean norm. In non-bipartite connected networks 
lEoll . we have A at < 2 and the initial distribution y always 
converges to the stationary distribution yo. 

The convergence of the limit in Eq. (1151 is dominated by 
the second largest eigenvalue of matrix P in absolute value, 



namely maxi = 2 ! ...jv |1 — Xi\. (The largest eigenvalue is as- 
sociated with the stationary state yo.) As a result, for any 
network, the mixing parameter is 



ji = max{l — A2, Ajv — 1}. 



(16) 



Therefore, the mixing is faster in networks where the eigen- 
values of the coupling matrix are concentrated close to 1. 

The condition for the stability of the synchronized states 
also requires the eigenvalues of the coupling matrix to be 
close to 1, although through a slightly different relation (R = 
Xn/X2 to be small). We can combine these two conditions 
to write an upper bound for the eigenratio R in terms of the 
mixing parameter: 



R < 



1 



1 



(17) 



This relation is relevant because of its general validity and 
clear physical interpretation. We show that this upper bound 
is a very good approximation of the actual value of R in many 
networks of interest. 

The mixing parameter fj, can be expressed as an explicit 
function of the mean degree k. Based on results of Ref. J22I1 
for random networks with given expected degrees, we get 



max{l - A 2 , X N - 1} = [1 + o(l)] 



Vk' 



(18) 



Moreover, the semicircle law holds and the spectrum of ma- 
trix P is symmetric around 1 for k m i n 3> Vk in the thermo- 
dynamical limit 1 22 ] . These results are rigorous for ensembles 
of networks with a given expected degree sequence and suffi- 
ciently large minimum degree k m i n , but our extensive numer- 
ical computation supports the hypothesis that the approximate 
relations 



A 2 



1 



Vk' 



X 



N 



1 



2 

Vk,' 



(19) 



hold under much milder conditions. In particular, relations 
dl9l are expected to hold true for any large, sufficiently ran- 
dom network with fc TO , n 3> 1. The rationale for this is that, 
for (3 = 1, the diffusion in each node of one such network is 
the same as in a random homogeneous network with the same 
mean degree, where relations dl9l are known to be satisfied 

Under the assumption that 1 — A2 ~ Ajv — 1, the eigenratio 
can be written as 



R 



1 



(20) 



where p is defined in Eq. (II6I 1. Therefore, the larger the mix- 
ing rate (smaller fi), the more synchronizable the network 
(smaller R), and vice versa. From Eq. ( H9L we have that the 
mixing parameter can be approximated as fx « 2/Vk and the 
eigenratio can be approximated as 



R: 



1 + 2/Vk 
1 - 2/Vk' 



(21) 
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Therefore, for (3=1, the eigenratio R is primarily determined 
by the mean degree and does not depend on the number of 
oscillators and the details of the degree distribution. 

This is a remarkable result because, regardless of the degree 
distribution, the network at (3 = 1 is just as synchronizable as 
a random homogeneous network with the same mean degree, 
and random homogeneous networks appear to be asymptot- 
ically optimal in the sense that R approaches the absolute 
lower bound in the thermodynamical limit for large enough 
k\9\. 



B. Numerical Verification 

Now we test our predictions in the models (i-iii) of SFNs, 
and we show that the synchronizability is significantly en- 
hanced for (3 = 1 as compared to the case of unweighted 
coupling (/? = 0). 

As shown in Pig. El in unweighted SFNs, the eigenratio R 
increases with increasing heterogeneity of the degree distri- 
bution (see also Ref. |8]). But, as shown in the same figure, 
the eigenratio does not increase with heterogeneity when the 
coupling is weighted at (3 = 1. The difference is especially 
large for small scaling exponent 7, where the variance of the 
degree distribution is large and the network is highly hetero- 
geneous (note that Fig.|2]is plotted in logarithmic scale). The 
network becomes more homogeneous as 7 is increased. In 
the limit 7 = 00, random SFNs converge to random homoge- 
neous networks with the same degree k m i n for all the nodes 
[Fig. 0a)], while networks with expected scale-free sequence 
converge to Erdos-Renyi random networks |31], which have 
links assigned with the same probability between each pair 
of nodes [Fig. |2b)], and growing SFNs converge to growing 
random networks, which are growing networks with uniform 
random attachment [Fig.|2jc)]. As one can see from Figs.|2jb) 
and 13c), the synchronizability is strongly enhanced even in 
the relatively homogeneous Erdos-Renyi and growing random 
networks; such an enhancement occurs also in SWNs. 

For (3 = 1, the eigenratio R is well approximated by the 
relations in Eq. (|20j [Fig.|2] dotted lines] and Eq. (|2lJ [Fig.|2] 
solid lines] for all three models of SFNs. This confirms our 
result that the synchronizability is strongly related to the mix- 
ing properties of the network 1 32]. For (3 = 1, the eigenratio 
of the SFNs is also very well approximated by the eigenra- 
tio of random homogeneous networks with the same number 
of links [Fig. 12 <>]■ Therefore, for [3=1, the variation of 
the eigenratio R with the heterogeneity of the degree distribu- 
tion in SFNs is mainly due to the variation of the mean degree 
of the networks, which increases in both random SFNs and 
networks with expected scale-free sequence as the scaling ex- 
ponent 7 is reduced [Figs.|2ja) and|2jb)]. 

In Fig. [3] we show the eigenratio R as a function of the 
system size N. In unweighted SFNs, the eigenratio increases 
strongly as the number of oscillators is increased. Therefore, it 
may be very difficult or even impossible to synchronize large 
unweighted networks. However, for (3 = 1, the eigenratio of 
large networks appears to be independent of the system size, 
as shown in Fig.[3]for the models (i-iii) of SFNs. Similar re- 
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FIG. 2: Eigenratio R as a function of the scaling exponent 7: (a) 
random SFNs, (b) networks with expected scale-free sequence, and 
(c) growing SFNs, for (3 = 1 (•) and (3 = (o). The other curves 
are the approximations of the eigenratio in Eqs. 1201 (dotted lines) 
and J2 1 1 (solid lines), and the eigenratio for (3 = 1 (dashed lines) 
and (3 = (dot-dashed lines) at 7 = 00. The symbols correspond 
to random homogeneous networks with the same mean degree of the 
corresponding SFNs (the degrees are indicated in the figure). The 
other network parameters are the same as in Fig.Q 



suits are observed in many other models of complex networks. 
All together, these provide strong evidence for our theory. 



C. General Bounds 

We present bounds valid for any network weighted at (3 = 
1. In this case, if the network is connected but not globally 
connected and N > 2, we have 



1 + (N - I)- 1 <R< 2NkD r , 



(22) 



where k is the mean degree and D max is the diameter of 
the network (maximum distance between nodes). This rela- 



tion follows from the bounds l/NkD„ 



< At < 1 and 



1 + (N-l)- 1 < X N < 2 |20]. For being valid for any 



network regardless of its structure, the bounds in Eq. i22\ are 
not tight for specific network models, such as random homo- 
geneous networks. Nevertheless, they provide some insight 
into the problem. In particular, heterogeneity in the degree 
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FIG. 3: Eigenratio R as a function of the number of oscillators for 
7 = 3 and the SFN models in Figs. |2{a)-(c), respectively. Dotted 
lines are guides for the eyes. The legend and other parameters are 
the same as in Fig. [2] 
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FIG.5: Normalized cost C/N a 1 as a function of j3 for random SFNs 
with scaling exponent 7 = 3. The other parameters are the same as 
in Fig.Q] 



distribution is not disadvantageous in this case because it gen- 
erally reduces the upper bound in Eq. \22\ . and this is a major 
difference from the case of unweighted networks considered 
previously |8]. 



V. COUPLING COST 

Having shown that weighted networks exhibit improved 
synchronizability, we now turn to the problem of cost. We 
show that the total cost involved in the network of couplings is 
minimum at the point of maximum synchronizability (J3 = 1). 

The total cost C involved in the network of couplings is 
defined as the minimum (in the synchronization region) of the 
total strength of all directed links, 

N 

C = <T min ^ k i~^> ( 23 ) 
i=l 

where cr m in — &1/A2 is the minimum coupling strength for 
the network to synchronize. We recall that cti is the point 
where the master stability function first becomes negative. For 
P = 1, we have C = Notify. 



In heterogeneous networks, the cost at j3 = 1 is signifi- 
cantly reduced as compared to the case of unweighted cou- 
pling (f3 — 0), as shown in Fig. |4] for random SFNs. The 
difference becomes more pronounced when the scaling expo- 
nent 7 is reduced and the degree distribution becomes more 
heterogeneous. The cost for SFNs at j3 = 1 is very well ap- 
proximated by the cost for random homogeneous networks 
with the same mean degree [Fig.|4l 0], in agreement with our 
analysis in Sec. II V Al that. at/3 = 1, the eigenvalue A2 is fairly 
independent of the degree distribution. 

As a function of (3, the cost has a broad minimum at j3 = 1, 
as shown in Fig. [5] for random SFNs. Similar result is ob- 
served in other models of complex networks, including the 
models (ii-iv) introduced in Sec. lIIIBl This result is important 
because it shows that maximum synchronizability and min- 
imum cost occur exactly at the same point. Therefore, cost 
reduction is another important advantage of suitably weighted 
networks. 



VI. DIRECT SIMULATIONS 

To confirm our analysis of enhanced synchronizability, we 
simulate the dynamics on networks of chaotic maps. 

The example we consider consists of SFNs of logistic maps, 
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are taken over 20 realizations of the networks. The other parameters 
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x n+ i = f(x n ) — ax n (l — x n ), where the output function is 
taken to be h(x) — f(x). In this case, the master stability 
function is negative for (1 — e~ r °) = ai < a < 02 — 



(1 



,-r, 



°), where To > is the Lyapunov exponent of the 



isolated chaotic map. In the simulations of the dynamics, the 
maps are assigned to have random initial conditions close to 
the synchronization manifold. 

We consider two values of the bifurcation parameter a for 
which the logistic map is chaotic: a = 3.58, where a^/ai « 
19, and a = 4.0, where 0.2/0-1 = 3. In both cases, our simu- 
lations show that, if R < a^/ai, then there is a finite interval 
of the overall coupling strength a m i n < a < a max where the 
network becomes completely synchronized after a transient 
time. Moreover, the simulations confirm that <r m in = 01/X2 
and a max = 02/ Ajy, as expected. In order to display the 
synchronization regions for different (3 in the same figure, 



and 



we introduce a* = cr]TV k\ 13 , a* mm = a rnin J2i k] 

In Fig. H we show the synchronization region 
{ a min> a max) as a function of the scaling exponent 7 in 
random SFNs, for (3 = 1 (•) and (3 = (o). The factor 
k]~ p is N for (3 = 1 and kN for (3 = 0. For a = 3.58, 
the networks are synchronizable for some a* in the region 
7 > 4.0 if the couplings are unweighted ((3 = 0) and in a 
wider region of 7 if the couplings are weighted at (3 = 1 
[Fig. Ha)]. In the region where both weighted and unweighted 
networks are synchronizable, the interval {Umin^max)^ m 
which synchronization is achieved, is much wider for (3=1 
than for (3 = 0. In terms of the original coupling strength a, 
the difference is even larger (k times larger). More strikingly, 
for a = 4.0, unweighted networks do not synchronize for 
any coupling strength, but the networks weighted at (3 = 1 
do synchronize for 7 < 4.0 in a nonzero interval of a* 
[Fig. lb)]. 

The cost C defined in Eq. d23i is exactly o* min . In agree- 
ment with the results in Fig. 0] <r* nin is clearly smaller for 
(3 = 1 than for (3 = in the interval of 7 where both weighted 
and unweighted networks are synchronizable [Fig. Ha)]. All 
together, the results in Fig. [6] illustrate the enhancement of 



synchronizability and the reduction of cost in weighted net- 
works. 



VII. CONCLUDING REMARKS 

Motivated by the problem of complex-network synchro- 
nization, we have introduced a model of directed networks 
with weighted couplings that incorporates the saturation of 
connection strength expected in highly connected nodes of re- 
alistic networks. In this model, the total strength of all /n-links 
at a node i with degree fcj is proportional to k\ , where the 
parameter (3 is a measure of the degree-dependent saturation 
in the amount of information that a node receives from other 
nodes. In a network of oscillators, the weights k]^ 13 can be 
alternatively interpreted as a property of the {input function 
of the) oscillators rather than a property of the links. We be- 
lieve that this model can serve as a paradigm to address many 
problems of dynamics on complex networks. 

Here we have studied complete synchronization of identical 
oscillators. We have shown that, for a given network topol- 
ogy, the synchronizability is maximum and the total cost in- 
volved in the network of couplings is minimum when (3 = 1. 
For large, sufficiently random network with minimum degree 
k m in ^> 1) the synchronizability at (3 = 1 is mainly deter- 
mined by the mean degree and is fairly independent of the 
number of oscillators and the details of the degree distribu- 
tion. 

This should be contrasted with the case of unweighted cou- 
pling {(3 = 0), where the synchronizability is strongly sup- 
pressed as the number of oscillators or heterogeneity of the 
degree distribution is increased. In the case (3 = 1, the hetero- 
geneity of the degree distribution is completely balanced and 
the networks are just as synchronizable as random homoge- 
neous networks with the same mean degree. 

Our results are naturally interpreted within a framework 
where the condition for the linear stability of synchronized 
states is related to the mixing rate of a diffusive process rele- 
vant for the communication between oscillators. Under mild 
conditions, we have shown that, the larger the mixing rate, 
the more synchronizable the network. In particular, in un- 
weighted networks, the mixing rate decreases with increasing 
heterogeneity. This, along with the condition (3=1 for en- 
hanced synchronizability, explains and solves what we call the 
"paradox of heterogeneity." This paradox refers to the (appar- 
ently) paradoxal relation between the synchronizability and 
the average distance between oscillators, observed in hetero- 
geneous unweighted networks |8], and is clarified when we 
observe that synchronizability is ultimately related to the mix- 
ing properties of the network. 

We expect our results to be relevant for both network de- 
sign and the understanding of dynamics in natural systems, 
such as neuronal networks, where the saturation of connec- 
tion strength is expected to be important. Although we have 
focoused mainly on SFNs, a class of networks that has re- 
ceived most attention, our analysis is general and applies to 
networks with arbitrary degree distribution. 
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